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Abstract 

In this paper, we propose a multiplex proportional-integral approach, for solving consensus problems in networks of heteroge¬ 
neous nodes dynamics affected by constant disturbances. The proportional and integral actions are deployed on two different 
layers across the network, each with its own topology. Sufficient conditions for convergence are derived that depend upon the 
structure of the network, the parameters characterizing the control layers and the node dynamics. The effectiveness of the 
theoretical results is illustrated using a power network model as a representative example. 
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1 Introduction 

Steering the collective behaviour of a network of dynam¬ 
ical agents towards a desired common target state is a 
fundamental problem in network control [11,12,21]. A 
paradigmatic example is the problem of achieving con¬ 
sensus, where the goal is for all agent states in the net¬ 
work to asymptotically converge towards each other [27]. 
The existing literature on consensus is vast and many 
extensions and different approaches have been proposed, 
e.g. [29,30]. Often, it is assumed that the agent dynam¬ 
ics are either trivial (simple or higher order integrators 
[31]) or identical across the network [33,19]. Also, the 
presence of disturbances and noise is often neglected. 

In contrast, many real world applications are modelled 
as networks of heterogeneous dynamical systems, and 
are affected by disturbances and noise. Take for instance 
a network of power generators, as those considered in 
[16,25]. Different power sources and transmission lines, 
multiple load variations, and even communication fail¬ 
ures between generators make the network highly het- 
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Fig. 1. (a): The network to be controlled is represented by 
black links and the blue and yellow connections represent the 
additional proportional and integral links that are used for 
control, (b) Multiplex representation of a network controlled 
by proportional and integral distributed controllers. 

erogeneous. The use of dynamic couplings implemented 
via the deployment of a distributed integral action has 
been proposed in the literature as a viable alternative to 
diffusive coupling when disturbances are present and/or 
the nodes are heterogeneous. A distributed integral ac¬ 
tion is used, for example, in [14] to prove convergence 
in a network of homogeneous first order linear systems 
affected by constant disturbances, while in [1] a simi¬ 
lar integral action is exploited to achieve consensus in 
homogeneous networks of simple and double integrators 
affected by constant disturbances. Further extensions of 
such distributed PI control to the case where the nodes 
have a more general homogeneous dynamics have been 
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reported in [34]. Applications have been discussed to 
achieve clock synchronization in networks of discrete¬ 
time integrators in [10], and for solving network conges¬ 
tion control problems in [42]. The use of distributed in¬ 
tegral actions is also often used to achieve synchroniza¬ 
tion in power systems; see for instance [32,36,1,5] and 
references therein. More recently, extensions have been 
proposed to the case where agents do not share the same 
dynamics. In this case the network is heterogeneous and 
fewer results are available particularly when the presence 
of disturbances, e.g. constant biases, is taken explicitly 
into account (see Sec. 1.1 for a more detailed discussion 
of the relevant previous work in the literature). In most 
of the available results, convergence is proved under the 
assumption that the integral action is deployed across all 
links in the network. Take for instance the recent work 
presented in [I] or the distributed PID approach in [7,8] 
(and references therein). 

In this paper we propose instead a multiplex strategy 
where the proportional and integral layer each possess a 
different structure (see Fig. 1(b)). The resulting closed- 
loop network is described by a multigraph (hypergraph) 
[6] which represents a class of networks recently defined 
as multiplex networks, which are the focus of much re¬ 
search attention in Physics and Applied Science (see the 
recent paper in Science [26]). Namely, according to the 
multiplex PI strategy described in this paper, two con¬ 
trol layers are used to steer the dynamics of the open 
loop network offering a new degree of freedom during 
the design: the possibility of selecting independently the 
structure of the integral layer from that of the diffusive 
proportional one. We show that the key analytical hur¬ 
dle represented by the presence of multiple Laplacians 
describing each of the layers in the multigraph can be 
overcome so as to obtain a rigorous proof of convergence. 
The conditions we find are global and can be used to 
tune both the gains and the structure of the two con¬ 
trol layers to achieve consensus, despite the presence of 
heterogeneities and constant disturbances. All the the¬ 
oretical results are illustrated via representative exam¬ 
ples that are also used to investigate the beneficial ef¬ 
fects (in terms of stability and performance) of varying 
the structure of the integral layer (while keeping that of 
the proportional layer unchanged). 

1.1 Relevant previous work 

The idea of using a distributed integral action to achieve 
consensus in a multi-agent system has been discussed in 
a number of previous papers in the literature often, but 
not always, under the assumption of homogeneous node 
dynamics. Here we give a brief overview of some key pre¬ 
vious work to better expound our results in the context 
of the existing literature. We wish to emphasise that the 
use of distributed integral actions is also common prac¬ 
tice to achieve synchronization and frequency control 
in power grids, see for example [32,36] and references 


therein. In [14], a distributed PI protocol is presented to 
achieve consensus in a multi-agent system. The proof of 
convergence is obtained for a network of scalar homo¬ 
geneous agents with possibly different gains for the P 
and I actions, but such that they are either both present 
on an edge or not. Basically, while the strength of the 
P and I couplings can be modulated independently, the 
structure of the P and I interconnections is assumed to 
be the same. Note that this assumption is crucial for the 
proof of convergence presented therein as is the hypoth¬ 
esis that all nodes share the same dynamics. This is also 
the case for the work presented in [1] where a distributed 
integral action is deployed to achieve consensus in a net¬ 
work of scalar, homogeneous agents in the presence of 
constant disturbances. The idea of using integrators on 
the Laplacian dynamics for arbitrary homogeneous lin¬ 
ear systems is also discussed in [33]. 

A more general approach is presented in the seminal 
work [39,40] where the problem is considered of achiev¬ 
ing output consensus in a network of heterogeneous lin¬ 
ear systems, subject to arbitrary (non-constant) distur¬ 
bances. Therein, the internal model principle is used to 
prove that exact (non-trivial) output synchronisation is 
only possible if the intersection of the agents’ spectra 
is non-empty. In practice, agents can only synchronize 
to “a trajectory generated by a dynamical system con¬ 
tained in the dynamics of each agent or exosystem” (as 
explained in [35]). As pointed out in [35] this condition 
is not always satisfied, as for example, in a network of 
heterogeneous harmonic oscillators. Also the structure 
of the proportional and integral layers is assumed to 
be the same. The use of the internal model principle is 
also adopted in [23] to study synchronization of hetero¬ 
geneous agents. The internal model principle is further 
exploited in [2] to extend the previous work in [14] and 
prove convergence in the presence of time-varying in¬ 
puts including polynomial inputs of known order and si¬ 
nusoidal inputs with known frequencies. It is also used 
in [3] together with incremental passivity to prove con¬ 
vergence in a network of nonlinear systems under a cer¬ 
tain class of disturbances. In particular, it is shown that 
consensus is achieved if the Laplacian describing the in¬ 
tegral layer is symmetric. Also, the integral action is 
based on the output of an internal model system and 
the disturbance is assumed to be generated by a known 
dynamical model. Finally, synchronization of heteroge¬ 
neous nonlinear systems is studied in a number of papers 
in the literature as for example in [38,13] and extensions 
of the internal model principle to this class of systems 
has been recently presented in [9,41]. When compared to 
the existing literature, in this paper we present a differ¬ 
ent approach based on the deployment of a distributed 
PI action in networks of heterogeneous linear agents in 
the presence of constant disturbances (or affine terms) 
and, unlike other previous work, when the control layers 
have different structures. We wish to emphasize that ar¬ 
guments based on the internal model principle (such as 
those reported in [39],[40]) to prove existence of a con- 
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sensus equilibrium cannot be applied in our case (see 
Remark 9 in Sec 4.1 for further details). 


2 Preliminaries 

We denote by In the identity matrix of dimension NxN; 
by 'Omxn a matrix of zeros of dimension M x N, and 
by Iat a X 1 vector with unitary elements. The Frobe- 
nius norm is denoted by H-H while the spectral norm by 
III-III. A diagonal matrix, say D, with diagonal elements 
di,..., dN is indicated by D = diag{(ii,..., dAf}- The 
determinant of a matrix is denoted by det(.), Afc(A) de¬ 
notes the /c-th eigenvalue of a squared matrix A, and 
A' = A -F A^ denotes the symmetric part of a matrix. 

Proposition 1 Given two vectors Vi G V 2 € 

and two matrices Qi € R™^”, Q 2 G 
some algebraic manipulations yield 

2vfQfQ2V2 < svfQfQiVi -I- -vJqJQ2V2,V£ > 0 

e 

( 1 ) 


Proof. Consider the m x 1 vector oQivi ± 6 Q 2 V 2 
with a,b G R"'". From its quadratic form one has 
(oQiVi ± 6 Q 2 V 2 )^ (oQiVi ± 5 Q 2 V 2 ) > 0 and 

Qf QiVi ± 2 a 6 vf Qf Q 2 V 2 + Q 2 V 2 > 0 

then, dividing both sides of the inequality by ab we have 
that 2 vfQ|’Q 2 V 2 < a/5vfQ^QiVi -f &/av^Q^Q 2 V 2 . 
Finally, setting £ = a/b we obtain (1). 

Lemma 2 Given a symmetric matrix A G R"^", de¬ 
noting by Amin (A) and Amax(A) the smallest and largest 
eigenvalues of A, the following statements are true [17] 

Amin(A)v^V < V^Av < Amax(A)V, Vv G R”"^^ (2) 

ll|A||| = max{|Afc(A)|} < ||A|| (3) 

Amin(A) F Amin(Ao) ^ Amax(Ao) F Amax(A) (4) 

where Ao G R^^^ is a principal sub-matrix of A (See 
Corollary 8.4-6 in [4])- 

Lemma 3 [4] Given the matrices A,B, C and D of 
appropriate dimensions, the Kronecker product satisfies 
the following properties 

(A O B)-f (A O C) = A O (B-f C) (5) 

(A(g)B)(A(g)D) = ABOBD (6) 

|||(A®B)||| = |||A||||||B||| (7) 


2.1 Algebraic graph theory 

An undirected graph 1# is a pair defined by = (N',£) 
where A/” = {1, 2, • • •, N} is the finite set of N node in¬ 
dices; £ C Af X Af is the set containing the P edges be¬ 
tween the nodes. We assume each edge has an associated 
weight denoted by Wij G R"*" for all i, j G Af. The weighed 
adjacency matrix A.(^) G R^^^ with Aij entries, is 
defined as Aij (if) = Wij if there is an edge from node 
i to node j and zero otherwise. Similarly, the Laplacian 
matrix C{if) G R'^^^ is defined as the matrix whose el¬ 
ements £ij{if) = j^i n>ij a i = j and —Wij other¬ 

wise. Thus, the Laplacian matrix can be recast in com¬ 
pact form as C (if) = diag{A.(i^)lAr} — where the 

matrix diag{A.(i^)lAr} is often called the degree matrix 
of the graph if. Given two graphs sharing the same set of 
nodes ifi = (Af, £i) and ^2 = (Af, £ 2 ), we define the pro¬ 
jection graph as the graph proj(f#i, 1 ^ 2 ) := (Af,£p) with 
associate adjacency matrix Ap := A(ifi) + A(if 2 ). 

Definition 4 [22] We say that an N x N matrix S = 
[Sij],\/i,j G Af belongs to the set W if it verifies the 
following properties: 

N 

(1) £ij £1 i ^ jj and Sa — Sij, 

(2) its eigenvalues in ascending order are such 
that Ai(5) = 0 while all the others, Xk(S), 
k G {2, - ■ ■, N}, are real and positive. 

The set of matrices W defined above are in fact a spe¬ 
cial instance of M-matrices as defined in [28]. Note that 
the Laplacian matrix C belongs to the set W if its as¬ 
sociated graph if is connected [27]. Next, we present a 
decomposition of the Laplacian matrix that will be cru¬ 
cial for the derivations reported in the rest of the paper. 
As suggested in [8] such a decomposition is particularly 
useful to prove convergence in the presence of heteroge¬ 
neous nodes. 

Lemma 5 [8] Let C G W be the Laplacian matrix of 
an undirected and connected graph ‘f, then C can be 
written in block form as C ~ RAR^^, where R is an 
orthonormal matrix defined with its inverse as 


R = 

1 ARi’i' 

, R-i = 

^11 

1 - 


Utv — 1 ^"^22 


_ 1 

^^22 J 


with 

^11 = 1^12 = (9) 

R 21 G R 22 G RiN-l)xiN-l) 

appropriate dimensions, A = diag{{), X 2 (C,), • • •, Xn(C)} 

with 0 = Xi(C) < X 2 (C) < ■■■ < AAr(^) being the 
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eigenvalues of C in ascending order. Also, the blocks in 
R and R~^ must fulfill the following conditions 

Tlli-n + (Rl2lAr-l ® In) = In (10) 
(R 21 0 In) + (R22lAf-l ® In) = 0(n(Ar-l)xl) (H) 

(R 2 iR ^1 ® In) + (R22R^2 ® ^n) = 

^’1i(R 21 ® In) + (R 12 R 22 ® In) = 0(lxn(Af—1)) (13) 

(R 21 R 21 ® In) = (R22lAf —lH-Af —1^22 ® ^n) (H) 

|||(R22®In)|||<^ (15) 

IIR 21 II < yA^|||R 22 ||| < ^{N - l)/N (16) 

R^ = A^R-^ (17) 
^'^22 = ( Iw-l + ( 13 ) 

Proof. See appendix A. 

Definition 6 A multigraph, is the set of M graphs 
.M := called layers of .M, where all 

the graphs in ./^ share the same set of nodes, that is 
% = (A/'.ffc), fork G 

3 Problem statement and multiplex PI control 

We consider the problem of achieving consensus in a net¬ 
work of N agents governed by open-loop heterogeneous 
dynamics of the form 

Xi{t) = Aixfit) + hi - +u.i{t) (19) 

for all i G Af, where Xi(t) G represents the state of 
the i-th agent, Ai G is the intrinsic node dynamic 
matrix, G R"^^ is some constant bias (or constant 
disturbance) acting on each node, cr is a non-negative 
constant modelling the global coupling strength among 
any pair of nodes, Cc,ij are the elements of the Lapla- 
cian matrix Cc of the weighed graph := {J\f,£c) 
representing the open-loop network to be controlled (see 
Fig. 1(b)), and Ui(t) G R"^^ is the control input. In this 
paper we assume that at least one bias b^ ^ ®(„xi) for 
some i G A/”. In so doing, the trivial solution is excluded 
that is associated to the case where all the agent dynam¬ 
ics Ai are exponentially stable with null biases. Indeed, 
in this case all nodes would achieve consensus onto zero 
and no distributed control action would be required. 

Definition 7 Network (19) is said to achieve admis¬ 
sible consensus if, for any set of initial conditions 
Xi{0) = Xio, there exists some non negative constant W 
such that limt^oo ||xj(t) — Xi(t)|| =0 for i,j G Af and 
||ui(t)|| < IF < + 00 , for all t>0. 

The problem we shall solve is to find bounded and dis¬ 
tributed control inputs Ui(t), such that all states Xi{t) 


converge asymptotically towards each other, i.e. admis¬ 
sible consensus. We then propose the use of a distributed 
multiplex PI control strategy, obtained by setting: 

N 

Mt) =c^pXl“b(xj(0-x*(t)) 


+ cri'^l3ij / (xj(t)- x,(r))dT 

j=i i 

where the non-negative constants > 0 and fiij > 0 
represent the control strengths of the proportional and 
integral control actions respectively (we do not consider 
self-loops, that is an = fin = 0). It is important to high¬ 
light that this controller allows the deployment of pro¬ 
portional and integral actions independently from each 
other {aij = 0 or fiij = 0 for some i,j £ Af, i ^ j). The 
constants ap, aj G R^ are additional parameters mod¬ 
ulating globally the contribution of each control layer 
with respect to each other. 

Equation (20) effectively defines two control layers each 
represented by a different weighted graph := {Af,£p) 
for the proportional layer and := {Af,£i) for the 
integral layer, where .Pp is the set of edges with asso¬ 
ciated weights aij and £i that with associated weights 
fiij. We denote the Laplacian matrices correspond¬ 
ing to each of these layers by £p := [Cp,ij] and 
Cl := [Lijj], respectively; with their elements being de¬ 
fined as Cp^^j = oiij and Cijj = fiij 

a i = j and Cpjj = —a^, Cjjj = —fiij otherwise. 
As depicted in Fig. 1, the resulting control strategy is 
therefore a multiplex distributed control strategy, and 
the closed-loop network a multiplex network associated 
to the multigraph Next, we define 

Cc '■= {Cc ® In), Cp := {Cp ® I„), Cl := (£/ ® I„). 
Letting x(t) = [xf (t), • • •, x^(t)]^ be the stack vector 
of all agent states and 

z(t) = [zf(t),...,z^(t)]^ :=-CT/Z/ / x(T)dT (21) 

Jo 

the stack vector of all integral states, the overall dynam¬ 
ics of the closed-loop network can then be written as 

k(t) ^ A n InN X(t) B 

_z(t)J [-CT/2/ ®(„ArxnAr) J [z(l) J [oj 

where A G is a block diagonal matrix en¬ 

coding the node dynamics, A := diag{Ai, • • •, A^r}, 
"H aCc -\-<7pCp, and B G is the stack vector 

of the constant biases, B := [b^, • • •, b^]"^. 

Thus, the problem becomes that of finding conditions on 
the node dynamics, the gains a, ap, and ct/, and most 
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importantly the structural properties of the open-loop 
network layer '^c and control layers and so as 
to guarantee emergence of admissible consensus in the 
closed-loop multiplex network (22). 

4 Convergence Analysis 

In this section we first show that the collective dynamics 
of the multiplex closed-loop network (22) has a unique 
equilibrium which is the solution of the admissible con¬ 
sensus problem. Then we derive some sufficient condi¬ 
tions guaranteeing asymptotic stability of such equilib¬ 
rium. 


Fi = 0. Therefore, existence of the consensus equilib¬ 
rium cannot he proved in our case following the ar¬ 
guments therein. Specifically, the assumptions of de¬ 
tectability made in [39] do not apply. 

Now, to prove convergence, it suffices to guarantee that 
(x*,z*) is globally asymptotically stable. We start by 
shifting the origin via the state transformation y{f) := 
z{t) -I- B so that (22) becomes 

i(t) 

.m 



A — TL InN 


x(t) 


— ajCl ‘OtnNxnN) 


yit) 


(24) 


4.1 Consensus equilibrium 


Proposition 8 If the matrix := (1/.^) 
is non-singular, then the closed-loop network (22) 
has a unique equilibrium x* := (Iat^Xoo) and 
z* := — (Ax* -I- B) where 


x^:=-(l/A)4/ri'Ef=ibfe (23) 


Proof. Setting the left-hand side of (22) to zero 
one has that x* = (Ijv ® v), Vv G and 

z* = — ^A(l 7 v 0 v) -I- B^ . From (21), we also have that 

(1^ (g) I„)z(t) = Onivxi, then (l^(g)I„)z* = ©„Arxi and 
we obtain 


Lemma 10 Let Ci = RAiR~^ and C 2 = UA 2 U“^ be 
two generic Laplacian matrices belonging to the set W, 
where R and U are block matrices with the same struc¬ 
ture as in (8) and Ak, k G {1,2} are diagonal matrices 
containing the eigenvalues of C\ and C 2 respectively. 
Then, 


(R~l£2R(g)In) 


®(nxn) ®(nx(nA^ —1)) 

0((„Ar-l)xn) (TA 2 T^(g)I„) 


_(25) 

where T = AR 22 (liv-il|(_i + Ijv-i)U |’2 o,nd A 2 = 
diag{\ 2 {C 2 ),-■ ■ ,\n{C, 2 )}. Moreover, TA 2 T^ is a 
symmetric matrix. 


Proof. See Appendix B. 


(1^ (g) I„)A(lAr (g) v) = -{1% (g) I„)B 
('/"> El, = -(l/iV) b* 

then V = —(1/A)’4'}'1 bfc = Xoo which completes 

the proof. 

Remark 9 

• Note indeed that if controller (20) is able to render 

this equilibrium stable, it is also able to guarantee con¬ 
sensus of all node states x(t) to a constant vector Xqo 
using bounded control energy. Also, the consensus tra¬ 
jectory can be interpreted as the solution of the “exo¬ 
system” given by s{t) = \I/iis(t) -|- (1/N^) bfc- 

Unlike the work in [jO] where the existence of the con¬ 
sensus equilibrium requires all the agents in the net¬ 
work to have eigenvalues in common; here, we just 
need to show that f&n is a full rank matrix. 

• Note that, in the notation of [39], our strategy cor¬ 
responds to setting the matrices B^ = = Ci = 

Gi = Hi = Ki = In and more importantly the ma¬ 
trix defining the own dynamics of the local controllers 


4.2 Error dynamics 

Assuming that the graphs in all layers of .JSI are con¬ 
nected, using Lemma 5 we can write Cc = RAcR~^, 
Cp = UApU-i and £7 = QA/Q-i. (In Corollary 13 
we relax the assumption of connectivity of the open-loop 
network). Next we define the error dynamics given by the 
state transformation e{t) = (R~^ (g) I„)x(t); therefore, 
using the block representation of R^^ and letting e(f) := 
[e'^{t),--- ,e%{t)f and x(<) := {t),-■ ■ ,x%{t)f, we 

obtain 

ei(t) =riixi(<) + (Ri 2 (g) I„)x(t) (26) 

e(t) = (R 21 (g) I„)xi(t) -I- (R 22 (g) In)x(t) (27) 

Thus expressing (R 21 (g) I„) from (11) and substituting 
in (27) yields 

e{t) = (R 22 (g) I„) (x(t) - (Ijv-i (g) I„)xi(t)) 

note that e{t) = © if and only if x(t) — (Iv-i <g) I„)xi(t) = 
0 since R 22 is a full rank matrix [ 8 ]. Then, admis¬ 
sible consensus is achieved if limt_,.oo e(f) = 0 and 
||y(t)|| < IT < -l-oo,Vt > 0. 
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Now, recasting (24) in the new coordinates e{t) and 
w(t) := R~V(t), and letting Ac := diag{A 2 (£cJ, • • •, 
AAr(/^c)}) Ap := diag{A2(£p), • • •, AAr(£p)}, Aj := 
diag{A 2 (£/), • • •, Xn{Ci)} we get 


e(t) = (^-n) e{t) + 

w(t) = -/3(TiAiTJ (g) I„)e(t) 


(28) 


admissible consensus is achieved if the following condi¬ 
tions hold 

i) The matrix = (l/A)^^j^Afc is non¬ 

singular, and its symmetric part is Hurwitz, 

a) ap\ 2 {Cp) > \ + p) - crA2(£c) 

Hi) \ 2 {Ci) > 0 and aj > 0 

where 


where w(t) := [w|’(t),..., w^(t)] Note that the dy¬ 
namics of wi ft) can be neglected as it is trivial with null 
initial conditions and represents an uncontrollable and 
unobservable state. The quantities in (28) are defined as 
follows 

• ^ is a block matrix defined as 


^11 ^12 
^'21 ’®'22 


(R“i (g) I„)A(R (g) I„) = 


(R 


®(nxn(A^ —1)) 


0 


{n{N — l)xn) 


(R(g)I„) 


where A := diag {A 2 , • • •, Ajv} is a block diagonal 
matrix. Using properties (10)-(13), we can write (see 
Appendix C for the derivation) 


’®'ii = (l/^)Efc.iAfc 

(29) 

’®'l2=Pl(Rf2®In) 

(30) 

’®'21 = (R-22 ® In)P2 

(31) 

^^22 = A(R22 (g) I„)H(R^2 0 In) 

(32) 

with 

H (ljv-il^_i <g> Ai) -f- A 

(33) 

Pi := [A2 - Ai,- • •, Aat - Ai] 

(34) 

P2:=[A^-Af,...,A^-Aff 

(35) 


• the matrix T/ = AR 22 (lAr-il?)-_i -f I]v-i)Q ^2 
obtained using Lemma 10 for (R~^ (g) I„)jC/(R(g) I„). 

• -R := (R-i (g)I„)?i(R(g)I„) and using again Lemma 
10 yields 


n = 


0 ®lx(Af-l) 

®(Af-l)xl crAc -f CTpTpApTp 


(g) In 


/ _ M 2 n 

P ■■= A„,ax (^Efe .2 ■ ^ 1 ) 

) (36a) 

V ■■= Amax (’®''ll) 

(36b) 

p := max {Amax (A/)} 
kGN 

(36c) 

Moreover, all node states asymptotically 
Xoo = -(l/A)’a>r/Er=ibfe. 

converge to 


Proof. From the assumptions, is a non-singular 
matrix; therefore, we have that the consensus equilib¬ 
rium (23) exists. Then, consider the candidate Lyapunov 
function (in what follows we remove the time dependence 
of the state variables to simplify the notation) 

^ = ^(efei-be^e)-|-^w^(T 7 A/Tf (g) I„) (37) 

2 2cr/ 

From Lemma 10 we know that TjAjTj is an eigende- 
composition of a symmetric matrix with positive eigen¬ 
values, which are the diagonal entries of A/; therefore, 
its inverse exist and it is also a positive definite matrix. 
Consequently, (37) is a positive definite and radially un¬ 
bounded function. Then, differentiating V along the tra¬ 
jectories of (28) and using expressions (30) and (31), one 
has 


U = Ui(ei) + U2(e) + U3(e) + U4(ei,e) ( 38 ) 

where, Vi(®i) = eftFnei, ^ 2 ( 0 ) = e^’®' 22 e, ^ 3 ( 0 ) = 
- 0 ^(cr(Ac(g)In)-l-crp(TpApTp(g)I„))©, and 14(01,0) = 
ef (Pi -I- P 2 ^)(R 22 In)e. Now, we proceed to hnd an 
upper-bound for each of the terms in (38). From the as¬ 
sumptions we know that -I- ^^1 is Hurwitz; there¬ 
fore, using (36b) and property (2), one has that 14 ( 01 ) < 
-(1/2) |77|0f0i. 


with Tp = AR 22 (lAr-il^_i -|-lAr_i)U|^ 2 ' 

4-3 Main Result 

Th 0 or 0 m 11 Consider the multiplex network (22) as¬ 
sociated to the multigraph ^ = {Sfcj^Pj^/}- Assum¬ 
ing the open-loop network structure tSc is connected, 


Next, consider the symmetric matrix ’S'' := ^ -b ’5'^; 
therefore, using (17) IF' = (R~^ (g)I„)(A +A^)(R(g)I„). 
Then, it immediately follows that Amax = P, 

where p is given in (36c). Now, we can write 14(6) = 
( 1 / 2 ) 0 ^^' 22 ®; from the fact that ^22 is a principal 
sub-matrix of IF', by using property (4) one has 14 ( 0 ) < 

p/20^©. 
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From Lemma 10 we know that TpApTp is a symmetric 
positive definite matrix. Hence, using (2) we have that 
V3(e) < -{a\2{Cc) + crpA2(£p))e^e. 


In the case where the graph associated to the open loop 
network Cc is connected, it is possible to use the follow¬ 
ing result that comes immediately from Theorem 11. 


Finally, setting vi = ei, V 2 = e, Qf = and 

Q 2 = R 22 ® In and using (1) yields 




V4(ei, e) < -el Ql Qiei -f —e^ Q 2 e 
2 2e 


< -e 


N 


fc =2 


(Afc - A'l) ei -f —e^Q^Qae 
2e 


Corollary 13 Let'^cp = proj{^c,^p) denotes the pro¬ 
jection graph of 5fp and Cep be its assoeiated 

Laplacian matrix; then, assuming ^cp is connected, the 
multiplex closed-loop network (22) reaehes admissible 
eonsensus if conditions i) and Hi) of Theorem 11 are 
fulfilled together while eondition ii) is substituted with 
X2{Cep) > (1/2) if,/iN\ri\)+p). 


We can further simplify this expression by notic¬ 
ing that Q|'Q 2 is a symmetric matrix and us¬ 
ing (2), (3), and (15), we can write e^Q^Q 2 e < 
|||Q 2 |||^e^e < (1/A)e^e. Then, using (36a) yields 
I4(ei,e) < (e^)/2e^ei -f l/(2Ae)e’^e. Exploiting all 
the bounds we found for each term in (38) yields 


Proof. Since the graph l^cp = proj(i^C)i^p) is con¬ 
nected then we have that Cep = UAcpU^ where U is 
the matrix composed by the eigenvectors of Cep and 
Aep = diag{0, A 2 (>Ccp)j • • • j AAr(jCcp)}- Hence, we have 
that TL = {Cep 0 In) in (22) and following a similar 
procedure as in Section 4 completes the proof. 


V < (1/2) (sp - hi) efei - (ctA2(£c) + crpA2(£p))e^e 


-f 




< ^lefei -f ^2e^e 


(39) 


Corollary 14 Considering a connected open-loop net¬ 
work with homogeneous node dynamics, i.e Ai = A,i G 
M where A and A' are Hurwitz stable. Then the closed- 
loop network (22), reaches admissible consensus for 
any connected proportional and integral graph topolo¬ 
gies with ap,ai > 0. 


where := ep, — h| < 0 and ^2 := l/(2Ae) -f p/2 — 
aX 2 {Cc) — <JpX 2 {Cp) < 0. Now, < 0 is ensured if 
£ < hi /p. Also, ^2 < 0 if condition ii) is fulfilled. There¬ 
fore, under the hypotheses, all agents in (19) achieve ad¬ 
missible consensus to Xqo as defined in (23). 

Remark 12 

• Note that the eonditions of Theorem 11 can be used 
as an effective tool to tune the control gain and/or 
rewire the control layers. 

• The stability analysis problem for the whole network 
has been simplified. In particular, rather than study¬ 
ing the stability of the 2nN x 2nN matrix in (22), 
only conditions i) and ii) need to be verified which 
only depend upon n x n matrices. 

• Note that condition (ii) can always be ensured by 
choosing up sufficiently large. Crucially, our bound, 
depending on the network structure and the node dy¬ 
namics, allows to estimate the threshold value of up 
reguired to guarantee global convergence. This can be 
extremely useful when tuning the gains in practice 
and also for network design. 

• It is important to highlight that optimal values for 
the proportional layer (up, X 2 {Cp)) can be obtained 
by properly labeling node 1 so that p is such that the 
quantity p/{N\ri\) in condition ii) is the smallest. 

• The topology of the integral control layer can be cho¬ 
sen arbitrarily. Hence, the independence of its struc¬ 
ture from that of the other layers allows to minimize 
the number of control interventions across the net¬ 
work. 


Proof. Firstly, note that when all nodes share the same 
intrinsic dynamics we have that /i = 0 in (36a), and 
= A. Hence, from the assumptions, conditions i) 
and iii) of Theorem 11 are automatically satisfied and 
from the fact that matrix A -f A^ is Hurwitz, one has 
that p < 0 in (36c); therefore, condition ii) of Theorem 
11 is also automatically fulfilled. 

Now consider the case where is not Hurwitz stable; 
then, it is possible to apply a local feedback control ac¬ 
tion to a subset of the nodes so as to render Hurwitz 

stable and guarantee the existence of the consensus equi¬ 
librium (x*,z*) in the closed-loop network. Or, equiva¬ 
lently, make the network consensuable according to the 
definition given in [37]. Specifically, consensusability can 
be achieved by adding an extra control input, say v^, 
onto a fraction K < N nodes so that H'n is stable. For 
example, one can choose the controller 

Vi{t) = HiXj(t) (40) 

where G is a gain matrix to be designed ap¬ 

propriately. Note that typically one could simply choose 
A = 1 so that the dynamics of just one node is altered 
by this feedback controller. 

Corollary 15 The heterogeneous network (19) is said 
to be consensusable under the distributed control action 
(40), if there exist matrices such that conditions i), 
ii) and iii) in Theorem 11 are fulfilled. 
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Remark 16 Note that the presence of local controllers 
acting on some nodes can he used not only for improving 
the closed-loop network stability, but also to change the 
value of the consensus vector . 


f.f Control Algorithm 

The results presented so far can be distilled into the 
following algorithmic steps to design the multilayer PI 
network control strategy proposed in this paper. Specif¬ 
ically, 

51 Compute matrix from the 

open-loop network (19). 

52 If matrix ’S'n and Hurwitz stable then go 

to step S4, otherwise go to S3. 

53 Design local controllers (40) such that together 
with its symmetric part are Hurwitz. Note that 
matrices can also be properly chosen for select¬ 
ing different values of the consensus vector Xqo in 
(23) 

54 Select any connected and weighed undirected graph 

for the integral layer e.g. a minimal spanning 
tree. Then compute the quantities /r, rj, and p de¬ 
fined in (36) 

55 Find a connected and weighed undirected graph 

for the proportional layer and a value of the 
global coupling gain cjp such that apX2{Cp) > 
(1/2) ipi/iN\r,\)+p)-cX2{Cc) 


4-5 Example 




(a) (b) 


Fig. 2. State space evolution of the heterogeneous net¬ 
work controlled by distributed proportional control for: (a) 
ap = 5 and (b) crp = 10. 



Fig. 3. State space evolution of the closed-loop multiplex net¬ 
work for (Tp = 19.3 and cr/ = 15 where the proportional and 
integral networks have both ring structures with all weights 
equal to 3 and 1 respectively. 

seen in Fig. 2, this can only guarantee bounded conver¬ 
gence. To achieve admissible consensus, we deploy next 
the multiplex Pl-Control strategy presented in this pa¬ 
per. Following the control design steps in Section 4.4, we 
have from SI that 


For the sake of simplicity and without loss of generality 
we consider three types of node dynamics; oscillatory 
(El), stable (E2) and unstable (E3) 



’ 0 1 ' 


’-1.5 0 ' 


’1 1 ' 

El := 

-1 0 

, E 2 :— 

-1 -1 

,E3 := 

0 0.5 


Then, we consider eight decoupled agents governed 
by (19), with cr = 0, = Ei,/c G {1,3}, A*, = 

E 2 ,fc G {2,5,7}, and A^ = E 3 ,fc G {4,6,8} and dis¬ 
turbances hi G given by B = [b}’, • • •, bg ] ^ = 

[0,10,0,30,0,1,20,0,30,30,60,10,-10,40,0,0]. Note 
that no disturbance is acting on the 8-th node and that 
some of the agents are marginally stable or unstable. 
Nevertheless, their average dynamics is characterised 
by a full rank matrix ’®'ii so that Proposition 8 ensures 
the existence of a consensus equilibrium while Theorem 
11 can be used to prove convergence under the action of 
our multiplex PI strategy. 

To show the effectiveness of such an approach, for the 
sake of comparison we start by using a distribnted pro¬ 
portional controller setting aj — 0 in (20). As can be 



’-0.1875 

0.625 


’-0.375 

0 

'S'li = 

-0.625 

-0.1875 

,’^'11 = 

0 

-0.375 


where is a full rank matrix and ’®'}i is a Hurwitz sta¬ 
ble matrix. Then, following S4 we select a ring network 
of 8 nodes with unitary weights (/3y = 1 Vi, / G Af) as 
the connected integral network, and from (36) we have 
that p = 59.8328, rj = 0.3750, and p = 2.618. From 
S5 we have that apX 2 {Cp) > 11.2812. Then, choosing, 
w.l.o.g again a ring network with aij = 1 'ii, j £ Af 
so that X 2 (Cp) = 0.5858, the closed-loop network of 8 
agents achieves admissible consensus for ap > 19.25. 

We choose ap = 19.3, and ct/ = 15. The result¬ 
ing evolution of the node states and integral ac¬ 
tions is shown in Fig. 3, where admissible consen¬ 
sus is reached as expected to the predicted value 
Xoo := -(1/A^)’®'n Efcibfc = [27.7064,-11.6881]^ 
and the integral terms remain bounded. 

4-6 Discussion 

The admissible consensus conditions presented in The¬ 
orem 11 only require the graph structure of the integral 

















Fig. 4. Different network structures with unitary weights 
considered for the integral control layer: (a) all-to-all, (b) 
star, (c) ring, and (d) Tree. Two-dimensional stability dia¬ 
grams varying the topology of [(e): all-to-all, (f) star, (g) 
ring, (h) tree]. Red regions denote parameter values where 
consensus is not achieved, blue regions those where consen¬ 
sus is attained. 


Fig. 4(e)-(f), varying the structure of the integral layer 
has a notable effect on the shape of the stability region. 
We also found that changing the structure of f#/ influ¬ 
ences the speed of convergence of the closed-loop mul¬ 
tiplex network towards consensus. Specifically, in Fig. 
5, we plot the time evolution of the consensus index 
dx ■— ||x(f) - (1/iV) ® In) x(t)||, where dx = 0 

indicates that the closed-loop network has reached ad¬ 
missible consensus. We observe that the structure of 
changes the speed of convergence. Obtaining an analyt¬ 
ical estimate of such a rate is a highly cumbersome task 
as discussed in [18], but some estimations can be found 
in the case where the agents are one-dimensional and 
homogeneous [8]. 

Finally, it is worth pointing out that in a practical im¬ 
plementation of the multiplex strategy (20), the rela¬ 
tive difference (xj(t) — Xi(f)) between agents may be 
affected by measurement errors [15,20,24]. This might 
render the integral terms unable to converge. In prac¬ 
tice, anti-windup strategies (saturations) can be added 
to the integral terms or higher order actions (e.g. PI"*) 
can be used. Also, the multiplex nature of the proposed 
PI strategy can be further exploited if an estimate of the 
measurement errors is available. In this case, given that 
the integral and control layers can have different struc¬ 
tures, integral actions can only be deployed on those 
edges which are less noisy than the others. Preliminary 
simulations (not reported here for the sake of brevity) 
confirm this observation which will be the subject of fu¬ 
ture work. 


5 Application to Power systems 





Fig. 5. Time response of the consensus index dx when the 
topology of the integral network is varied 

layer f#/ to be connected. However, in general, we found 
that the stability of the consensus equilibrium and the 
rate of convergence are affected by the specific choice 
of To illustrate this point, we considered different 
structures for the graph while leaving unchanged, 
and computed two-dimensional stability diagrams in the 
control parameter space (crp, aj), see Fig. 4. Namely, at 
each point in the (crp, aj) space, we computed the max¬ 
imum eigenvalue of the error system dynamics (28) de¬ 
picting in blue those points where the eigenvalue is neg¬ 
ative (consensus is achieved) and in red those where it 
is positive (convergence is not attained). As shown in 


In this section, we show that the convergence analysis 
used to prove stability of the multiplex PI strategy de¬ 
veloped in this paper can be effectively used to prove 
the emergence of synchronisation in heterogeneous net¬ 
works of power generators. Specifically, we consider N 
power generators governed by the swing equation [25] 

(41) 

where Hi and wp are constants representing the iner¬ 
tia and reference frequency for the i-th generator. The 
quantity P™(t) := P* — diSi{t) is the mechanical power 
provided by the i-th generator and it is composed by 
a constant power injection P* and a damping term 
di6i{t),di > 0 which models power losses and primary 
control loops. Moreover, Pp^*{t) is the power demanded 
by the network. Note that when (41) is at rest onto 
an equilibrium, P/" = P"®* and the frequency of each 
generator uji{t) := di{t) remains equal to a common 
constant for all generators in the grid. For the sake of 
simplicity, we linearize the swing equation (41) around 
the synchronous state U!i{t) = ■■■ = WAr(t), letting 
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rrii = 2Hi/uJii, we obtain [1] 


= -d^uj^(t) + P* - + Vi{t) (42a) 

N 

Pr\t)= Y. (42b) 

i=l j'/i 

where Ei > 0 is the nodal voltage, and Yij is the admit¬ 
tance among buses i and j. To achieve synchronization, 
we consider the distributed control protocol 

= — (hoJiit) +crpY, Ep,iji^i{t)] (43) 
rrii \ ^-^k=i ! 


CTpA 2 {P) > + max {ki-—\ (45b) 

Ally’ll! i L mj 


Proof. Note that (44) can be seen as a group of N first 
order heterogeneous agents controlled by a multiplex PI 
strategy. Specifically, letting Ai = ki — di/m, the dy¬ 
namics of each node can be written as 

Wj(t) = AiUJiit) +b^- ap Y.f=i Ep,ij^j{t) + Zi(t) 
Zi{t) = -(1/m) Y.f=i -C/.y Wj(t) 


with ki € M. being a constant representing a local feed¬ 
back gain for the zth-node, crp > 0 and Cp gW repre¬ 
senting the Laplacian matrix of the proportional layer 
with link weights Oy. Now, let /3ij := EiEj \Yij \ be 
the weights on each edge of the power network in (42b) 
and Cl gW the associated Laplacian matrix describing 
the equivalent distributed integral action (42b). Setting 
z{t) = — (l/mi)P”®*(t), the problem becomes that of 
proving convergence in the heterogeneous network given 

by 


LJ{t) = {H —apCp)uj{t)+z{t) YH (44a) 
i{t) = (44b) 

wherea;(t) := [a;i(t), • • •, WAr(t)], z(t) := [zi(t), • • •, zw(t)] 
are the stack vectors of frequencies and rescaled electri¬ 
cal powers respectively, H := diag{A:i — di/mi , • • •, kN — 
dAr/mAf}, M := diag{l/mi, • • •, 1/mAr} and the vec¬ 
tor B := diag{P//mi, • • •, P/f/mAf}. The closed-loop 
power system (44) has the same structure of the multi¬ 
plex network (22) where the input biases represent 
the rescaled constant power injections P*/mi of each 
node. 

Proposition 17 The closed-loop power network (44) 
has a unique equilibrium given by oj* := WooIat, 
with Woo := -Y.^=i P*/Y.f=i - di) and z* := 

— (wooHl^v + B) 


Proof. As done in the proof of Proposition 8, by setting 
the left-hand side of (44) to zero, one has that x* = 
oIn, Va G R and z* = — (aPl -I- B). Now letting v := 
[mi, • • •, mAf]^, by the definition of z{t) one has that 
v^z(t) = 0. Therefore v^z* = 0 and we obtain a = 
-v'^B/v^HIat =: Woo 


Corollary 18 Under the control dynamics (43), the 
power network (42) with m^ = m, m > 0 Vi G A/” asymp¬ 
totically converges to Woo if the following conditions are 
satisfied 


i’ll 



(45a) 


Therefore, using Theorem (11) with cr = 0, and aj = 
(1/m) completes the proof. 


5.1 Illustrative example 

As an illustration, consider the power network shown 
in Fig. 6(a). For the sake of simplicity, and with¬ 
out loss of generality, we consider all line admit¬ 
tances and nodal voltages to be Yij = 0.0001 and 
Ei = 2kV \/i,j G Af respectively. Moreover, we as¬ 
sume m = 0.2 and four different values of damp¬ 
ing, that is di = 0.5, for i G {1,4,7,8,11,14}, 
di = 0.45, i G (2,6,9,13,15}, d* = 0.40, i G {3,10,12}, 
while di = 0.6, i G {5,16}. Furthermore the vec¬ 
tor containing the nominal power injections (ex¬ 
pressed in MW) for each node is given by P* = 
[40,30,30,22,10,20,50,35,50,20,30,25,30,20,17,30]. 
Following the approach in [1], we assume that the net¬ 
work has been operating in these nominal conditions for 
t < 0 [see Fig. 6(c)]. As the power network (44) has a 
natural integral controller which encode the phase angles 
Si{t), consensus is expected on a value dependent on the 
network parameters and the nominal power injections. 
Such a value can be easily computed from Proposition 
17 by setting all ki = 0 yielding Woo = 60i7z. 

Now, consider the scenario where, at t = Os the nomi¬ 
nal power injections are decreased by 600kW from the 
nominal value at buses 4, 8 and 10 and consequently, the 
frequencies of all generators decrease as well. To com¬ 
pensate those disturbances, we use local feedback con¬ 
trollers on a fraction of nodes together with a distributed 
proportional action to manipulate and stabilize the de¬ 
sired convergence value. Specifically, we introduce feed¬ 
back controllers with appropriate gains at nodes 1, 3, 5, 
8, 10 and 14 [denoted by self feedback loops indicated 
in black in Fig. 6(a))] in order to shift Woo to the de¬ 
sired value Woo = 60. To address the stability of such 
consensus equilibrium, we use Corollary 18. Firstly we 
find that z/ii := —2.3875 and condition (45a) is fulfilled. 
Secondly, we have that max^ {ki — di/m} = 2 and there¬ 
fore the power network reaches admissible consensus if 
(TpA 2 {Cp) > 6.3991. Choosing a simple path graph for 
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0 5 10 15 

t[s] 


(c) 

Fig. 6. (a),(b) Network architectures representing the inte¬ 
gral and proportional control layers respectively. The gains 
of the proportional layer are set as aij = 200. (c) Evolution 
of the power network. The blue dash-dot line represent the 
convergence value ujoo ■ 

the proportional control layer as shown in Fig. 6(b) yields 
cTp > 0.8326 to guarantee convergence. Heuristically, we 
found that setting ap = 55 also ensures that the max¬ 
imum frequency overshoot during transient is less than 
(necessary to avoid unwanted damage to the 
grid). The behaviour of the closed-loop power network 
is shown in Fig. 6(c) where the distributed controller 
is switched on at t = 0.1. As expected we observe the 
power network to quickly regain stability onto the de¬ 
sired target frequency. 

6 Conclusions 

We have proposed a novel approach for controlling 
networks of heterogeneous nodes with generic n- 
dimensional linear dynamics in the presence of constant 
biases (disturbances). In particular, we discussed the 
use of different control layers, each with its own topol¬ 
ogy, deploying proportional and integral actions across 
the network. We proved convergence of the strategy and 
derived conditions to select the control gains as a func¬ 
tion of the open loop and control network structures 
and the node dynamics. We showed the effectiveness of 
the proposed strategy via numerical simulations on two 


representative examples. 

Several open problems are left for further study. First 
and foremost the effect of varying the structure of the 
network control layers should be studied in more detail as 
preliminary results show the performance of the network 
evolution towards consensus can be affected by such vari¬ 
ations. We wish to emphasize that more sophisticated 
approaches can be developed by considering other linear 
or nonlinear control actions rather than the simpler pro¬ 
portional and integral actions considered in this paper. 
For example a robustifying distributed action could be 
designed by considering an extra network control layer 
of variable structure controllers. This is currently under 
investigation and will be presented elsewhere. 
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A Proof of Lemma 5 


As the Laplacian matrix is symmetric (the graph is undi¬ 
rected), according to Schur’s lemma, there exists an or¬ 
thogonal matrix, say V such that C — VAV~^ where 
the eigenvectors of C are column vectors of V (or equiv¬ 
alently row vectors of V“^). The eigenvector associ¬ 
ated with the null eigenvalue of C is given by Vi = 
W/y/N, • • •, I/a/TV]. Then, rewriting V in block form one 
has that 

r Vii Vi2' 

_ V 21 V 22 _ 

where Vn = l/y/N and V 21 = (l/'\/]V)i|/_i, 

V 12 G and V 22 G IR(^-i)x(y-i)_ 

straightforward algebra yields, 

1/7V (l/iV)l^_/ 

{ 1 /VNM 2 a/VNNL. 

Thus, setting rn = 1/N, R 12 = l/iVl^_p R 21 = 
(l/-\/]V)Vf 2 andR 22 = (l/-\/]V)V^ 2 obtain (8). Also, 
since V“^V = R~^R = Ijv, the blocks in the defini¬ 
tion of R and R~^ must fulfill conditions (10) — (14). 


1 vWVi2 
S-Af-l VN'V22 
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Moreover, |||V ^||| = \/Amaa;((V“i)^V“i). Also, as 
V-i = and VV^ = In one has = A^R-^; 

therefore, |||R^^||| = I/VN and IIIR22III < lll^^^lll 
together with (7) yields (15) . 


= l/iV(U^ 2 )~^(lw-ilw-i + Ijv-i)“^R^ 2 ^ and us¬ 
ing property (18) we obtain = iVU 22 (lAr-il^_i -I- 
lAr_i)R ^2 = which completes the proof. 


B Proof of Lemma 10 


C Derivation of ^ 


Multiplying both sides of C 2 = UA 2 U“^ by R~^ and 
R, yields R~^/^ 2 R = R“^UA 2 U~^R. Now using the 
block form of R and U as shown in Lemma 5 one has 
that R~^£ 2 R is given by 


^■11 Ri 2 


1 Aui; ■ 

R 21 R 22 _ 


_ iw-i AU 22 _ 


0 ®lx(Af-l) 
®(Af-l)xl -^2 


r Mil U12 


1 iVRi;' 

(M 

IM 

P 

iM 

P 

_1 


I7V —1 -^1^22 


where A 2 = diag {A 2 (jC 2 ), • ’ ‘) ^^(£ 2 )}- By definition 
Mil = rii and U 12 = R 12 (see (9)), and by some matrix 
manipulation we obtain 


rii-I-Ri2lAr-i A(miiUD^-I-Ui2U^2) 
R 2 I + R22lAr-l A(R2 iU^2 + I1'22U|2) _ 

0 ®lx(Af-l) 

®(Af-l)xl -^2 

Mil + Ul2lAf-l A(miiR^1 + R-12R22) 

U 21 -I- U 22 lAr-l A(U 2 iR ^1 + U 22 R|" 2 ) 

(B.l) 


We next simplify each block of all matrices. Then, from 
( 10 ) we have that ru + Ri 2 lAr-i = wn -I- Ui 2 lAr-i = 
1 . While, from (11) R21 + R22lAf—1 = U21 + U22lAf—1 = 
0 and using ( 13 ) A(miiU^i -|-Ui2Uf’2) = A(riiR^2 + 
Ri 2R^2) = ®- Note also that R21 = —R22lAr-i and 
U21 = —U22lAr-i- Thus, the blocks 

Ti :=A(R 2 iU^i+R 22 U^ 2 ) .g 2 ^ 

= AR22(lAf-llw-l + lAf-l)U^2 

and, 

T 2 :=A(U 2 iR^i+U 22 R^ 2 ) 

= AU22(lAf-ll^_l + lAf-l)R^2 

Consequently, we have Ti = T2 and letting T = Ti, 
the Kronecker product (R~^£2R ® In) yields ( 25 ). 
Finally, to prove that TA2T^ is a symmetric ma¬ 
trix we have to show that is an orthonormal 
matrix. Then, from (B. 2 ) and from the fact that 
R22 is an invertible (full rank) matrix [ 8 ] one has 


Using the block decomposition of R as done in Appendix 
B, we have 


^ := 

1 

to 


^llln ( 1^12 ^ In) 


(M 

IM 

CN 

• 5 * 


_ (R 21 0 In) (1122 ^ In) _ 


-1 

> 

0 


In -^(Illl ® In) 

1- 

0 

>1 


(l-Af —1 ® In) A(R |^2 ® In) 


where = rnAi -t- (R 12 0 I„)A.(lAr_i (g) I„), ’ 5 'i 2 = 
N (riiAi(R|’i (g) In) -f (Ri 2 0 I„)A(R ^2 ® In)), ’®'21 = 
(R 21 (g) In)Ai -I- (R 22 (g) In)A(lAr-l <g) In),_and ’®'22 = 
A(R 21 (g) I„)Ai(R|; (g) In) -f A(R 22 (g) I„)A(R |2 (g) In) 

Now, by some algebraic manipulations we can simplify 
each block of IF. Then, by definition ru = 1/N and 
Ri 2 _= and ^'ii = (l/A)(Ai + {ll_, ® 

I„)A(liv_i (g) !„)) which is clearly (29). For the second 
block we can add and subtract AAi (Ri 2 R^ 2 C>In) where 
Ri 2 = (1/A)1^_^. Hence, using (13) one has 

’®'l2 = ((l^_i(g)I„)A-Ai(l^_l(g)I„))(R^2 0ln) 

'-V-' 

Pi 


note that the matrix Pi can be recast as Pi = 
[A 2 A 3 • • • Aiv-i] —[Ai Ai • • • Ai] = [A 2 —Ai • • • Aiv — 
Ai] and then ( 30 ) is obtained. Then, following a similar 
procedure as done before but for 4^21 adding and sub¬ 
tracting (R22lAr-i <8 In)Ai, and using property ( 11 ) 
we obtain 

^21 = (R22 <8 In) (A(lAr-l (g) In) — (IaT-I <8 I„)Ai) 

P 2 

in this case P2 can be rewritten as P2 = [Af’ — Ai^, • • •, 
A^ — Ai ]^. Finally, from properties ( 11 ) and ( 13 ) 
we can express (R21 (g) In) = ~(Il22lAf-i <8 In) 
and (Rji (g) In) = —(l/rii)(Ri2R|’2 In) and the 
last block reads ’®'22 := A(R22 (g) In)Ai(R22^ (g) 
In) + A(R22 (g) In)A(R22^ (g) In), where Ai := 
(Iv-i (g) In)Ai(l^_;^ (g) In). Note that Ai can also be 
written as Ai = (Iv- ilv-i C) Ai) and by grouping 
common terms we obtain ( 32 ). 
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